Search AI Products and News

Qafind Labs recently released its newly developed ChatDLM model, an innovative achievement that has drawn widespread attention in the field of artificial intelligence. ChatDLM is the first model to deeply integrate "Block Diffusion" and "Mixture of Experts (MoE)". It achieves an astonishing inference speed of 2,800 tokens/s on GPU, supporting an ultra-large context window of 131,072 tokens, ushering in a new era of document-level generation and real-time conversation.

Cerebras Systems recently announced the construction of six new data centers across North America and Europe to bolster its artificial intelligence (AI) inference capabilities. This expansion significantly increases the company's computing power, supporting the growth of various AI applications. The plan allocates 85% of computing capacity to the US, with three facilities already operational in Santa Clara and Stockton, California, and Dallas, Texas. Upcoming centers will be located in Minneapolis (expected Q2 2025), Oklahoma City, and Montreal.

The Mamba team's research focuses on distilling the large transformer model Llama into Mamba by designing a novel inference decoding algorithm that significantly enhances inference speed. The research aims to leverage Llama's extensive knowledge while reducing the high cost of training large models from scratch. The research team successfully transformed Zephyr-7B and Llama-38B into a linear RNN by combining progressive distillation, supervised fine-tuning, and preference optimization methods.